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FOREWORD 


The "Cost Benefits of Space Communications Technology" project under 
Contract NAS 3-19700 was conducted by the Engineering Experiment Station 
(EES) at Georgia Tech in conjunction with the School of Industrial Manage- 
ment (IM). The program was administered under Georgia Tech Project A-1739 
by the Systems Engineering Division of the Applied Engineering Laboratory. 

This report describes the work, performed during the period May 1975 
through May 1976. The program was managed by the NASA/Lewis Research Center 
Space Flight Systems Study Office. The NASA Program Manager was Mr. Steven M. 
Stevenson. 


The Georgia Tech Project Director was Mr. Larry D. Holland with 
Dr. Peter Sassone serving as Associated Project Director. The project 
was conducted under the general supervision of Mr. Robert F. Zimmer, 
Chief of the Systems Engineering Division. In addition to the project 
director, the project team was comprised of the key personnel listed 
below along with their principal area of contribution. 


P. G. Sassone (IM/EES) 
J. G. Gallagher (EES) 

S. L. Robinette (EES) 

F. H. Vogler, Jr. (EES) 


Cost-Benefit Methodology 
Millimeter and Optical Systems 
Applications 

Communication Systeros/Systems 
Analysis 
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SUMMARY 


This research program addresses from an economic point of view the questions 
of (1) whether or not NASA should support the further development of space com- 
munications technology and (2) which technology support, if any, should be given 
the highest priority. The objective of the program is an assessment of the potential 
benefits from a cost-benefit viewpoint o^ NASA space communications technology. 

The developed cost-benefit methodology consists of a qualitative test for appro- 
priateness of government support and a set of three quantitative stages of analysis 
based on the concept of net present value (NPV) , The qualification test for gov- 
ernment involvement is based upon probable market failure from such phenomena as 
externalitites, public good, excessive risk, unemployment, economies of scale, 
balance of payment, and national security. The overall methodology is sub-divided 
into three parts; screening, assessment, and ranking. Screening is composed of 
the qualitative test for government involvement, NPV estimation, and NPV sensi- 
tivity analysis. The assessment methodology approximates the probability density 
function of the net present value whose mean is estimated in the screening method- 
ology. The ranking methodology is based upon several statistics which are measur- 
able from probability density functions. 

User-preference and technology state-of-the-art surveys were conducted to 
form a data base for the technology evaluation. The research program encompasses 
near-future technologies in space communications, earth stations, and satellites, 
including the non- communication subsystems of the satellite such as the station 
keeping, electric power, attitude control, etc. 

Results of the research program Include the conclusion that the screening, 
assessment, and ranking methodology provide a consistent, tractable, defensable, 
and quantitative approach to evaluating potential NASA R & D programs. The fi'^e 
technologies ranking highest in terms of their mean net present value are, in 
decreasing net present value, as follows: 

(1) Millimeter Communications Systems 

(2) Solid state power amplifier 

(3) Low cost earth station 

(4) Multi-beam antenna 

(5) Ion engine. 
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Economic evaluation of the technologies from a cost-benefit viewpoint has 
shown that certain technologies should be Implemented with government support to 
accrue maximum benefits to the nation as a whole. Based on this analysis, NASA 
should play an Important role in advancing future communications technology. 
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SECTION I 


INTRODUCTION 


This research program, Cost-Benefits of Space Cosmunication Technologies, 
addresses what Is at once a very important practical problem and a very difficult 

conceptual problem. The practical problem is the decline of the U.S. position 
of leadership in the world market for space conmunlcatlons technology. The once 
unchallenged U.S. lead In this area has wavered considerably since the federal 
government budget cuts of a few years ago which forced the cancellation of most 
governn^nt supported advanced space communication technology development. Other 
nations, with considerable R&D backing from their governments, have established 
aggressive programs in space communication systems development and marketing. 

U.S. private industry has apparently been imable to match the competition Imposed 
by the foreign government-supported communication programs. 

The conceptual problem In this research has two aspects. First, while there 
is widespread agreement that NASA should re-enter this research area and, Indeed, 
is highly qualified to do so, is such work justifiable in terms of widely accepted 
criteria for government action? Second, assuming a positive answer can be given 
to the first question, how does one select which of many possible R & D projects 
NASA should pursue? 

The Georgia Tech research team's approach has been to address both of these 
questions directly. We have maintained the position, buttressed by an apparently 
strong consensus among economists, that government's proper role is to fill per- 
serverlng vacuums left by the private sector, not to displace private activity 
nor to create its own R & D niches. The tell-tale signs of a persevering vacuum 
are the dual observations that some activity would be in the best interests of 
society while, at the same time, no private firm is motivated to undertake that 
activity. The economic theories of externalities and public goods go a long way 
toward explaining how such seemingly anomalous circumstances may arise. Thus, 
the mere absence of private sector R & D in some area is not taken as sufficient 
evidence that government activity is warranted. Rather, it must also be shown 
that the R & D is, in fact, in the best interests of society and that private 
sector reluctance is more than a temporary phenomenon. The former is established 
by the methods of cost-benefit analysis, while the latter bears on the underlying 
economic characteristics of the R & D activity and its potential market. 


The research activity performed under this contract can be divided Into 
three parts: methodology development, data gathering, and methodology appll 

cations. The overall methodology Is referred to as, simply, the evaluation 
methodology. As will be discussed. It has three component a^thodologles : 
screening, assessment, and ranking. 
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SECTION 2 


COST BENEFIT METHODOLOGY DEVELOPMENT 

Ihe Identification of input data, the proceasing of that data, and the 
interpretation of quantitative results can all be pl/3ced under the rubric of 
evaluation inethodol<%y . The methodology in a cost-benefit analysis is as impor- 
tant as, indeed is analogous to, the experimental design in a laboratory study. 
Both must be designed so that observed results logically support or refute the 
points being tested. Both must be carefully implenmnted so actual results are 
not biased by unknown factors. And both must be carefully docusmnted so that 
conclusions may be verified by Independent reproductions. These are the over- 
riding considerations in the Georgia Tech team’s approach to analytic cost-benefit 
methodology. 

The methodology In this study has been shaped by two further considerations; 
the large nund>er of technology items (hence potential R6«D pr(^rams) \dilch need to 
be evaluated, and the peculiar potential Impacts that some NASA R&D programs 
would have on the private R&D sector. With regard to the latter, consideration 
must be given to whether the potential NASA R&D program would displace a similar 
private program, or vrtiether It would be In addition to private programs. In the 
case of displacement, would the NASA Program be undertaken sjoner than the dis- 
placed private program? If so, would the temporal advantage outweigh the dis- 
placement disadvantage? However, to what extent would the NASA R6:D, even If It 
were a displacement, stlimjlate further private R&D? 

The R&D evaluation methodology was developed to meet five criteria. First, 
the overall methodology must be iaternally consistent. It was recognized early 
In the research program. Indeed In the program RFP, that the mechodology would 
have to be developed as a series of filters. Since a large number of advanced 
technologies would ha'/e to come under scrutiny. It was recognized that time and 
resources would not permit a detailed Investigation of each one. Hence, a 
screening of technologies was demanded, where the screening would filter the 
entire set of technologies and reject the least promising. Only those tech- 
nologies successfully passing through the screening would be subjected to a 
formal assessment. Finally, only those technology development programs which 
proved worthy under the formal assessment would go on to be ranked for imple- 
mentation priority. Thus, the evaluation methodology consists of three steps; 
screening, assessment, and ranking. It is clear that these tlirce methodologies 
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'Which cOBiiricc the cvcrall evaluation mthodolog*' auat be conaiatent with each 
ocher. That ia, eadi ahould be baaed on the aani> conception of what conatitutea 
a "good" K&C ^rogras. It would be aelf-defeating if, for exaii^»lc, projecta 
idiich failed acreening would tend to do very well in a foraial aoaeaanent. 

Internal conaiac^ney o»ng the three atethodoli^ieB ia achieved b)- grinindii^ 
each in Che cane coat-benefit criterion; net preaent value. The difference 
among the atepa are accounted for by the level of detail, n<A by the concef^ual 
approach . 

The aecond criterion ia relevance. By thia, it ia meant that the neth- 
^ology tauat properly addreaa the correct reaeardt iaaue, and nuat lead to 
quantitative reaulta %Hiich logically eatabliah Che true value of a apecified 
potential HASA R&D pr^ram. Simply put, the methodology nwat be relevant to 
the iaauea. The l4iq»ortance of the formal conaideration of thia criterion be- 
cornea evident when one facea the diatinction between the aocial value of an 
R&D project and the social value of NASA* a performance of the R&D project. 

Ordinary coat-benefit analysis would address the fors^r. However, the latter is 
the real Issue in this research. Hie methodology must be so framed as to address 
the latter Issue. 

The third criterion is traceability. The methodology imist strike the proper 
balance between realism (thus cooqilexiCy) and abstraction (simplification) . The 
methodology must account for the salient aspects of the problem, yet remain simple 
enough to be operational. 

The fourth criterion is replicability. The methodology must be consistent 
with the scientific method: i.e., it meat permit the same results to be 4 jhieved 

by different investigators. Thus, as naich as possible, the methodology must be 
based on objective rather Chan sdijective, inputs. 

The final criterion is defensibility. The methodology must be theoretically 
and practically sound. It must prove reasonable to even avowed critics. 

These criteria, coupled with the necessity to treat numerous technologies 
and the complications of government undertaking activities which might be con- 
sidered to be in the private domain, gave rise to a three-stage evaluation pro- 
cedure. The three stages, as mention^, are screening, asaessB^nt, and ranking. 
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2.1 Screaiing Mfeaw^logy i 

Th« ketisodology has three cM^oneats; qualification, net 

present value (NFV) estiaation, and sensitivity analysis. By qualification 
is aeant that an attirapt is Bade to deteraine iHieth^r, and to vhat extoit, 
the technology in question qualifies as a legitiaate govemraent research 
pK)graa. Lef Uiaacy is established by reference to the set of characteris- 
tics i^ch econoBlsts have determined apply to projects sore efficiently 
undert^n In the public, rather et'sn the private, sector. That is, priority 
is always accorded the private sector because, if conpetitive conditions are 
dosiniuit, the private sector will Dost efficiently pursue the maxlimaB welfare 
of society. However, certain structural conditions of the econoa^ and/or 
characteristics of the project Itself may intervene to foil the blind 
beneficience of the competitive econoi^. In these cases, it may be argued, 
govenmnt is properly involved in the provision of the good. 

The NPV estimation is accomplii^ed via an equation which partitions 
the flow of benefits and costs of NASA's undertaking the project into stages 
of imequal time length. The stages roughly correspond to periods In the 
life cycle of the tectmology. A key parameter in the estimating equation is 
the "delay factor" which indicates how long private development of the 
technology would lag its NASA develoj^nt. Thii; factor results in assigning 
a NPV of 0 to a project which simply displaces an equivalent private 
program, and assigns the full project NPV only when the private sector 
would never undertake the project. 

Sensitivity analysis is performed on the parameters of the NPV estima- 
ting equation. One at a time, each parameter is varied over + 50% while all 
other parameters remain fixed at the!,* most likely values. For technologies 
which survive screening, the sensitivity analysis highlights the critical 
p. 3 rameters deserving most attention in the subsequent, more detailed 
assessi^nt and ranking methodologies. 

2.2 Assessa^nt Methodology: 

The assessment methodology involves a more sophisticated use of 
the basic NPV estimation equation. The eqttatlon is linearized by a Taylor 
expansion and probability density functions (PDF) are determined for the 
input parameters. A NPV PDF is analytically derived. This PDF not only 
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allows an estiaate of the aean HPV, but its distribution as «mll. In 
general, for a given mean HPV of R&D progruis, lesser variance is 
preferable to greater variance. 

2.3 R5mkjng Methodology 

The ranking methodology acts on those pot^tial R&D projects vdiich 
survive assessn^nt. Ranking Is a tm-step process. First, a Monte 
Carlo simulation of the NPV of the project is performed, resulting in 
an empirical probability density function and its associated cumulative 
density function. Since each PDF has a number of statistics associated 
with it, ranking cannot be reasonably based on a single statistic, such 
as mean value. Rather, different positions toward risk are parai^trically 
adopted, along with relevant statistics, and rankings are derived for 
each risk attitude. 
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SECTI(»I 3 


SURVEYS OF USER NEED AND TEOINOLOGY 


Qmtact was established with the camsunications industry, govem- 
nent agencies, and other entities that provide conssmications services 
and w1k> sake use of space cooDunications teclmology in order to ascertain 
and define their present and future needs. Their technology preferences, 
demand projections, and estimate of ot-her fact rs influencing the rate of 
Innovation Introduction into their systems were polled. Opinions on the 
degree of demonstration required for user acceptance of nev technology has 
been sought. Also, a survey of the state-of-the-art of space communications 
technology has been made in order to relate specific technology ite^ to 
particular needs and to identify areas of new technology that if developed 
woul'* best satisfy those needs. Emphasis has been placed on items which 
have -r)t yet been incorporated into operational systems but which indicate 
potential benefits. In contacting the appropriate groups, consideration 
has been given to the total communications systm including directly associated 
groxmd equipment as well as the space segment. Based on this survey, par- 
ticular technology items or areas have been specified for cost benefit analysis. 

3.1 User Need Survey 

The purpose of the user sur/ey was to ascertain and define the needs, 
choices, and preferences of the providers/users of space communications 
technology, which would influence the rate of innovation introduction into 
future satellite communication systems. The survey sought to determine user 
acceptance of (or resistance to) new concepts, and to measure demand for 
space communications. 

The survey elements consisted of a list of user organizations to be 
contacted and a set of questions to be asked of each user contacted. 

The list of user organizations was structured to include providers of 
satellite communication services (since providers of service are users of 
the technology) and also users of satellite conmiunication services. The 
latter category included business, government, and social service agencies. 
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The questions to be asked in the course of the survey were desired 
to elicit inforaation deemed to be useful for the cost-benefit study. 

The structure of the cost-benefit screening methodology itself depended 
to some extent on the user survey information* while the information required 
depended on the demands of the cost-benefit iKthodology. 

Users of presently active space communications facilities were xmavare 
of the l^llcations of the new technology. Many of these contacted were 
inmersed in problons common to any new* high technology enterprise during 
1975 — adequate financing. They were preoccupied with converting existing 
technology into productive enterprises. 

Contact was established with representative members of the satellite 
consBunlcations Industry, government agencies, aiul others who either provide 
or use satellite communications technology. The initial list assembled 
for the survey was generated from news Items and other references in techni- 
cal and trade literature and Included 60 organizations. Thirteen were 
providers; 47 were users of satellite communication services. Providers 
were defined as those organizations which owned a working satellite, or 
had active applications for licenses before the FCC to own satellites. Users 
were defined as those organizations which neither owned nor intended to 
launch satellites. The 47 users included 19 government and non-profit 
public service organizations and 28 profit-oriented organizations. 

Out of the initial list of providers and users of satellite communi- 
catl(xi technology, 42 were contacted. Eight were providers of satellite 
communication service; 34 were users. Of the users, 17 were government/ 
public service agencies and 17 were private corporations. (Table 3.1 lists 
the organizations contacted.) 

3.2 Technology State-of-the-Art Survey 

The main objective of this study was to assess the potential benefits 
of NASA space communications technology. As a part of that assessment, a 
survey has been made of technology currently available for application, 
technology in the development stage, and technology in the planning stage. 
This survey of the state-of-the-art of space communciations technology has 
considered the total communication system, including directly associated 
groimd equipment as well as the space segment. Correlations have been 
established between new technology items and the forecasted needs and 
applications for space communications. 
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ORGANIZATIONS CONTACTED IN 
SATELLITE COMML'NICATION USER SURVEY 


! 

■MiMHIliA 


d 

















m 







• 








U 



a 







o 




d 




d 



o 







d 




o 



• 

14 

d 


.*4 







M 




fH 



O 

o 

u 













U 



d 

a 

3 


d 




• 




d 

■ 


d 



M 

|4 

u 


o 




0 



CO 

o 

d d 






0 

•H 




CO 


o 

•d 


d "H 

0 d 


u 




u 

4J 


c 


d 



d 


o 


•H I— 1 


o 



10 




3 


o 


60 

d 


•H 

d 

u 


CO 



d 

00 

d 


§ 

d 

•H 


c 


■ 

U 

kt 

d * 

>» 

CO 



d 

d 

M 


1 

o 



■rl 

d 

a 

d 

0 

d CO 

d 

< 



•H 

•H 



O 

4-1 

d 


U 

q 


u 

cu 

0 d 

d 





u 

a 


u 


d 


CO 

•H 

o 

•w 

1.1 

a d 

Ql. 

00 


d 


CO 

3 



d 

44 

> 

nj 

01 

o 

d 

o 

d .f-i 

B 

d 


o 

d 

d 

Q‘ 

d 

u 

u 

d 

u 

o 

•H 


3 

u 

O i4 

0 

.1-1 

d 

..4 

d 

u 


d 

»rl 

o 

3 


t> 

> 

(0 

g 


CJ 

o 

js£ 

u 

4J 

d 

■3 

O 

d< 44 

o. 

g 

(0 

d 

(U 

d 

g 

d 

CO 


CJ 

.H 

d 

M 

d 

U 

s 

•i4 

M 

g 

3 

o 

»— 1 

0 

O 

u 

M d 

d 

3 

M 

o 

0 

U 

o 

U 

O 

0 

T3 

w 

0) 


o 

d 

d u 

d 


44 

O 


u 

d 

u 

d 

o 

u 

d 

PQ 

H 

U 


Q 

4J d 

o 

H 

o 


n 

cu 


Oi 



M 



d 

d 


a 4J 





d 



d 


d 

•d 


d 

d 

u 

<— 1 

rH 

B w 

d 

d 


o 


d 

d r4 

d 



0) 

d 

d 

•H 

x> 

d 

o 

d 

d 

o 

u 

4J 

d 

n) 

o 

w 


M 

u 

o 

u 

d 

d 

d 

iJ T3 

o 

o 

(0 


d 

•i4 

o o 

d 

d 

0 

d 

•H 

•H 

2 

o 

o 

a d 

.H 

.H 



d 

■o 


1 

jc: 

o S 

> 

M 


g 


•H 

d 4-1 

M 


d 

d 

"d 

d 

V4 

d 

u 

d 


•<-1 

(U 

d 

g 


U 

•H 

d 

d 

a 

N 

3 

d 

d 

o 

3 

.H 

H 

1-1 

II 

o 

u 

o 

u 

d 

2: 

d d 
H 3 

II 

O 

a 

3 

s 

14 

CLI 

cS 

u 

1 

o 

o 

O 

ca 

d 

H 

H 

M 



i 






60 

d 



















(0 




•H 













01 






14 




4-1 













d 






d 




01 

01 

d 




c 







o 




d 


CO 




fl 

d 

o 




c 







rH 




o 




u 


d 

d 

4H 

01 



♦H 







4-1 




rH 




d 

o 

■3 

•H 

4J 

d 

44 


(A 

01 




c 


3 



d 

4J 



01 

u 

o 

d 

> 

CO 

o 

o 


W 

d 


d 


•r^ 


d 



o 

3 



d 

d 

CO 

o 

14 

d 

rH 



•H < 

o 


u 


03 


•H 



rH 

14 

44 


•H 

d 

'iH 

14 

d 

3 

4J 

U 


§ < 

■H 


•f4 


ij 


d 



4J 

4J 

0 


U 

u 

O 

6Q 

ca 

■3 

CO 

d 


a CD 

4J 


> 


c 


3 



3 

01 



d 


d 



M 

d 

d 


O J 

3 


14 


3 





4J 

•H 

d 


d. 

d 

d 

u 

d 



a 


U 

d 


d 


o 





14 

d 

0 


01 

o 

14 

•H 

o 

44 

d 

4J 



*r4 


ca 


'SI 


o 


d 

o 

•H 

•r4 



■H 

cL 


‘H 

O 

3 

l4 


rH d 

d 






u 


> 

CL 

a 

4J 



CO 


J3 

01 


E 

cO 


3 -r4 

3 


60 

d 

>> 




|4 

0) 

3 

3 


T3 

>.4 

c 

3 

■H 

w 

g 

a 


d 4J 

g 


c 

d 



d 


3 

d 

< 

l4 


d 

> 

d 

CL, 

> 

d 

O 

d 


O 01 

g 


•H 


o 


o 


ca 

3 


4J 


u 

d 

CO 


d 

d 

U 

Q 


•H 3 

0 


4J 

> 

o 


•r4 



IH 

d 

3 


« 



U 


e 




60 i-l 

a 


01 

u 

a: 


Ml 


•-H 

H 

o 

•r^ 


iH 

d 

4-1 

o 

d 

4J 

01 

d 


d 

d 


3 

0) 



3 


3 


•H 

d 


01 

H 

o 

b 

H 

14 

0) 

4J 


PCJ 44 

rH 


d 

CO 



d 


U 

44 

4H 

•rl 


Ofi' 





to 


cO 


O 

d 


3 


o 

• 

3 


•rl 

o 

3 

a 



.H 

d 

d 

rH 

a 

2 

4J 


d 

H 


3 

r-J 


u 

3 

d 

60 


•H 

3 


J-l 

fO 

01 

0 

d 

d 


ta 


3 4-1 



O 



C2 

CL] 

0 

O 

Ml 

> 

< 


d 

d 

d 

•rl 

d 

Q 

4H 


d 

rH d 

44 


14 

U 

0 

H 


•rl 

rH 

d 

< 



d 

o 

d 

4J 

o 


o 

j«i 

o 

Ld d 

O 


03 

CO 

•H 


d 

4J 

o 

d 


d 


B 


o 

d 

*,H 

CO 


l4 

•H 

d a 




0 

U 

•> 

14 

3 

d 

a rH 

a 


d 

u 

•r4 

|4 

4J 

'H 

3 

O 

4J 

3 4-1 

d 

>> 

d 

CL, 

d 

to 

d 

•rl 

O 

4H 

3 



M 

ej 

■3 

o 

CO 

60 

CO 

>4 

CO 

rH 14 

d 

d 




Q) 

XI 

u 


14 

14 

U 


d 

a 

X! 

Q, 

d 

14 

d 


U 

3 3 

'H 



• 

V 

U 

4H 

0 

• 

3 

d 

•M 


> 

d 

d 

l4 

3 

O 

14 

5 

3 

D. a 4 h 

’ — 1 

XI 

in 

'd 

d 

3 

w 

ca 

O. 3 

U 


o 


V4 

O 

TJ 

d 

3 

d 

3 

CL d 

U-i 

O 

3 

• 

0) 

.u 

O 

01 

• 

d 


jg 


o 

W 

C 

u 

W 

u 

« 

Z 

W 

< Q 

O 

CL, 

CM 



c/^ 

ca 

< 

3 

Q 





d 











o 











•H 











Ml 





• 



01 



3 





o 

0) 


c 



14 



c/5 


u 

u 


o 



0 



C 



•H 


•f4 



CL 



o 


X 

•> 


4J 



14 



’H 


a 

u 


3 



O 





3 

0) 


u 



u 



d 


14 

CO 


•H 






a 


60 



d 



d 



•H 


d 

(D 


3 



4J 

H 


c 


rH 

U 





•H 

•< 


:3 

H 

d 

— f 








g 


H 



0 



f-H 

S 


n 

iG 


rH 


u 



0) 

o 


O 


d 

05 


1 



u 

u 


O 

o 

0 

u 


d 



d 




o 

•H 

d 


rH 



CO 

u 



— ^ 

C 

CO 


d 


01 


H 


d 

X 

tJ 



H 


l4 

c 

O 

H 

Xi 

QQ 


rH 

y— s 



d 

d 

'r. 


o 

M 

d 

d 

cn 

C 


3 

*H 

H 

CO 


'w' 

l4 

d 

0 

u 


•H 

CJ 


H-J 

3 


d 

o 

-C 

d 


> 

M 


U1 



4-1 

*H 


4J 

CJ 

O 

0) 


H 


1-3 

01 

iJ 


01 

• 

M 

§ 

H 


u 


d 

d 

hm 

d 

c 

CM 


< 


Od 

U 


2: 



i— i 


i 


i 


9 


Department of Commerce 
Medical University of South 
Carolina 

American National Red Cross 


I 


A review of related tvclmical reporte ai^ artlclea available In the 
open literature was conducted by (1) reviewing literature already available 
in the Engineering ExperiTOnt Station staff files, (2) using the technical 
indices of the Georgia Tech Library, (3) reviewing pertinent literature 
supplied by NASA/Lewis, (4) monitoring related periodicals, and (5) periodi- 
cally reviewing the NASA/SCAN abstracts. The relevant articles were copied 
and filed according to the technology classification structure described below. 

A literature review provides a broad basis of information on the 
related technologies, but current state-of-the-art information is available 
only through direct contact with those engineers in industries and government 
agencies currently working with the fast-moving space communications tech- 
nology. Accordingly, telephone interviews and visits by Georgia Tech 
personnel were conducted with several companies and agencies. Space 
communication industry facilities visited during the technology survey 
include Scientific-Atlanta, Inc., Westinghouse (Baltimore), General Electric 
(Valley Forge, Pennsylvania), Watkins Johnson (San Francisco), Comsat 
Laboratories (Clarksburg, Maryland), Varian (San Francisco), Aerospace 
Inc., TWR, Aeronutronic/Ford, Lockheed Missile and Space Division, AYDYN 
Energy Systems, Hughes Space and Communication Group, and Hughes Electron 
Dynamics Division. Government agencies visited Included U.S. Air Force 
SAMSO, NASA/Ames, and NASA/Goddard. In addition to the visits at these 
facilities, later telephone conversations were held with these "experts" 
to discuss specific technologies and to solicit opinions as to parameter 
values for the cost-benefit analyses. 

A technology classification structure (TCS) was developed for orderly 
handling of technical literature and interview documents. The TCS is as 
shown in Table 3.2, and serves as an outline for the major portion of 
this section. Subsection 8.2 of the project report [1] contains a detailed listing 
of many sub-technologies and devices classified according to the structure. 

Results of the user survey and the technology survey have been combined 
to select a set of conceptual technology systems which will meet the near 
future user needs by incorporating technical innovations. These conceptual 
systems are then analyzed by the cost-benefit methodology developed in Section 
1 through 5 of the project report [1]. The selected conceptual 
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TABLE 3.2 

TECHNOLOGY CLASSIFICATX(»i STRUCTURE (TCS) 


I. Ground Station 

A. User Connection 

B. Modulation Techniques 

C. Recelver/Transmltter 

D. Antenna 

E. Pro{Mgation Media 

II. Launch and Injection 

A. Launch 

B. Transfer Orbit 

C. Synchronous Orbit (Satellite Locations) 

III. Satellite 

A. Structure 

1. Station Keeping 

2. Attitude Control 

B. Support 

1. Electric Power 

2. Thenaal Control 

C. Comnoinlcatlon Equipment 

1. Antenna 

2. Transponder 
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syMeos raa^ froa grotmd station ItaiM to aatallite aubsyataBa to total 
coBBMmlcatlon ayata&s. They have been selected so as to be representative 
of the total group of space communication technologies. The conceptual 
ay sterna technologies are as folloirs: 

- Low Cost Earth Station Receiver Technology 

- Ion Engine Technology 

- Millimeter Coraninlcatlon System Technology 

- Laser Coamiunlcatlon System 

- RF Attitude Sensor 

- Satellite Solid State Power Amplifier 

•* Multibeam Antennas 

- Advanced Solar Arrays 

- Adaptive Heat Pipes 

Each of these conceptual system technologies is analyzed In Sections 11 through 
14*. and a description of tha concepts and the mechanisms of the benefits are 
given there. Ion engine technology is analyzed In Section 11; low cost earth 
station technology is analyzed In Section 12; and the remaining seven technologies 
are analyzed in Section 13. Section 10 describes the baseline scenarios used In 
application of the methodology to the conceptual systems. 


flE!»ROD0CIBILrrY OF Tim 
oMtSNAt. PAGE IS POOR 


* All section references In this Executive Summary refer to the main project 
report [1]. 
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SECTION 4 

ASSESSMENT OF SELECTED TECHNOLOGIES 


4.1 Methodology Ittpleaentatlon 

Application of the screening methdology produces both the estii&ated 
NPV of the proposed technology development program and a graphical sensiti- 
vity analysis of the NPV with respect to each Input parameter. In the 
assessment methodology, each of the screening Input parameters is supplen^nted 
with an estimate of the range of parametric values In either standard devia- 
tion of the NPV of the proposed technology development program. This estimate 
assumes a Gaussian NPV distribution. (This is an assumption which can be 
Intuitively argued from the law of large numbers.) The ranking methodo- 
logy is a comparison of key parameters of the NPV cumulative distribution 
functions (CDFs) for the individual technology development programs. This 
CDF Is generated for each technology being ranked by a Monte Carlo simula- 
tion which utilizes either a Beta or a Gaussian random number generator 
for selecting input parameters of the NPV equation and repeatedly evaluates 
the NPV for the random samples of input parameters. 

The ^k}nte Carlo simulation used in the ranking process produces a 
sample-estimate NPV CDF; the analytic estimation of the CDF's standard 
deviation (o) calculated in the assessment methodology assumed a Gaussian 
CDF. The Monte Carlo simulation requires significant!}' more computer time 
than does the analytic (assessment) method. Application of the (Hil-squared 
confidence test to specific examples during this project has Indicated that 
the >fonte Carlo simulation results are close to being Gaussian such that 
the analytic estimation is generally a valid approximation. 

Since each stage of the quantitative cost benefit methodology is an 
evaluation of the NPV of NASA-induced early technology development, each 
methodology requires estimation of the same parameters (but to varying 
degrees of specification) . The overall methodology not only has commonality 
between its three parts, but also is intentionally formulated for the 
maximum commonality in its application to widely varying technologies. This 
commonality is accomplished in the conq>uter programs by use of a NPV model 
with four generalized phases of the scenario: (1) basic R&D (NASA), (2) applied 
R&D (industry), (3) prototype development, and (4) operation. Input data 
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fot Mch mcluxtology lnclu4«s (a) the probability of going into the phaaa, 

(b) the tj^ durati<m (length) of the phase^ (c) the annual coats of the 
phase, and (d) the aimual benefits of the phase. In addition, own specifies 
the discount rate to be used in the analysis and the expected delay tiiM 
in developaent of the technolo^ wittu>ut efforts. The assessi^nt and 
ranking prograns also require specification of ranges for these variables. 

By allowing the benefits of the teclmology developiMnt program to be 
entered into the methodolo^ BK>dels as an estimate of the annual benefits 
during the operational phase, one can use the same basic methodology for all 
technologies, even though the form of their benefits may be radically different. 
Estimation of the annual benefits for technology development is made separately 
in the analysis of each technology by methods appropriate for the technology. 

4.2 Summary of Screening and Assessment Results 

Screening and assessment methodologies have been applied to nine space 
communication technologies in Sections 11, 12 and 13. The assesst^nt 
s^thodology was applied to each exan^ile technology here in order to 
allow investigation of the consistency of screening and assessment; normal 
application would result in assessment of only a higher-scoring subset of 
the screened technologies. 

The nine space communication technologies analyzed above are listed 
in Table 4,1 in decreasing order of screening scores, along with their 
screening scores (estimated NPV) and their NPV standard deviations as 
calculated by the approximate Gaussian technique of the assessment metho- 
dology, It can be seen from this table that the three top-scoring 
technologies (millimeter, solid state power amplifier, and low cost earth 
station) have estimated NPVs approximately an order of magnitude greater 
than the lower-scoring technologies. The millimeter communications tech- 
nology is estimated to have a $24 million NPV as a result of (1) its 
significantly increased channel capacity and (2) its long delay time for 
non-NASA development. The latter factor follows from the very large invest- 
ment required for development and flight demonstration of the millimeter 
technology. Solid state power amplifier (14 GHz) technology scored well 
as a result of the low estimated development cost and associated satellite 
useful-lifetime extension. The relatively high screening score for the 
direct demodulation receiver technology for low cost earth stations resulted 
from the anticipated large number of applications. 
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TABLE 4.1 


TEfflNOLOGY SCREENING AND ASSESSMENT RESULTS 


Technology 

Screening Score 
NPV(M$) 

Assessment 

Standard Deviation (M$) 

1. Mllllo»ter Cosmunl cat ions System 23.8 

11.5 

2. Solid State Power Amplifier 

22.5 

5.6 

3. Low Cost Earth Station 

10.9 

2.1 

4. Multibeam Antenna 

4.0 

1.1 

5* Ion Engine 

3.2 

0.8 

6. Adaptive Heat Pipe 

1.8 

0.5 

7. RF Attitude Sensor 

1.7 

0.4 

8. Laser Communication System* 

1.1 

2.7 

9. Advanced Solar Array 

0.5 

0.1 


*Laser system data based upon use of approximate break-even benefits. 
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Midway in the acreening score range are the satellite imiltlbera 
antenna rad ion engine technologies. ‘Hie nultlbera antenna tectaology 
score was held down by the relatively large developMnt cost* idiile the 
ira engine teclmology sccre was loirared by the snail estinated delay tine 
without MASA support* The score of the laser coaminication systrai is rat 
particularly significant since it is based upon an equivalent annual benefit 
selected near the break-even value in the absence of quantified braeflts. 

It should be noted that the sensitivity plots of Appendix II can be used to 
recompute the screening score for a change in estimated value of one or rare 
screening input parameters. 

In addition to the screening scores* Table 4.1 also contains the 
approximate (Linearized Gaussian) standard deviation of the technology 
project NFVs determined by the risk analyses In the assessment rathodology. 
Figure 4.1 slu^s the Gaussian PDF and CDF curves as functions of mean ifi) 
and standard deviation (o). By using the screening score and standard 
deviation (assessment) from Table 4.1* one can sketch the approximate 
NPV* PDF and CDF for each of the technologies to gain additional insight 
into the likely outem^s of the technology development projects. A large 
standard deviation, relative to the mean, Indicates a high degree of 
uncertainty or difference of opinion among the "experts" polled for the 
input parameters; it is inversely proportional to the confidence one 
has in the screening prediction of project value. 

4.3 Summary of Ranking Results 

Our methodology to this point results in each technology being charac- 
terized by its NPV PDF which cannot be adequately summarized by a single 
statistic. Rather, each PDF exhibits a nuod)er of potentially equally in- 
teresting statistics, e.g., mean, mode, minimum, maximum, standard deviation, 
range, PROB(NPV>K)(K"constant) , size of confidence Intervals, etc. In 
general, it is one's attitude toward risk which Influences ^Ich Is the 
most useful ranking statistic. 

Following the concept of a risk spectrum, the nine technologies can 
be ranked according to statistics vdtlch appear to capture the sense of the 
spectrum points. These points, their associated statistics, and the corres- 
ponding rankings are presented In Table 4.2 . Five technology rankings have 
been developed, vdiich one is best? The Georgia Tech research team would opt 
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Figure 4.1a 

Gaussian Probability Density Function, 
ItonBallzcd for Mean v and Standard Deviation o. 


CDF 



MPV»ii 

a 


Gaussian Curaulatlve Distribution Function, Noraalized 
for Mean it and Standard Deviation o. 
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TABLE 4.2 


RANKING TECtQK)LOGIES 







RANKING* 





RISK ATTITUDE 

STATISTIC 

1 

2 

3 

4 

5 

6 

7 

8 

9 

Ultra Conservative 

MIN NPV 

C 

£ 

B 

F 

J 

A 

D 

G 

H 

Somewhat Conservative 

PROB(NPV 0) 

(A 

B 

C 

D 

E 

F 

J)**G 

H 

Moderate 

A m 

M - O 

C 

G 

E 

B 

F 

J 

A 

D 

H 

Someiidiat Risky 

li 

G 

C 

E 

B 

F 

A 

J 

H 

D 

Very Risky 

MAX NPV 

G 

C 

E 

H 

B 

F 

A 

J 

D 


*Code letters Identifying technologies are 


Letter 

A 

B 

C 

D 

E 

F 

G 

H 

J 


Technology 
Adaptive Heat Pipes 
Multibeam Satellite Antennas 
Solid State Power Amplifiers 
Advanced Solar Arrays 
Low Cost Earth Station 
Ion Engines 

Millimeter Communication System 
Laser Communication System 
RF Attitude Sensor 
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for Che ranking given by Che s^derace risk atcicude, using che scaciscic 
M~o. There is very substanCial agreeaenC bectraen che w-d and m and HAX HPV 
rmkings tdiere <,he designatim denotes our esCinated value. We take che 
esciisaced values to be che best escinaces of che true values. The only 
substaittlal difterence between u-o and MIN NPV or PR0B(NPV>0) is che place- 
Mnc ut Technology G* MilliaeCer Coanunication Systems. These differences 
are e..:illy ext-'lelned. With regard to MIN NPV, G has a large possible range, 
which is expected from a technology with a high mean value. Certainly a 
low MIN NPV slv»uld cotmc against a cectmology. However, che probability 
of a negative NPV is only 2%. The technology is not as risky as the ordi- 
nal MIN NPV ranking might overtly suggest. With regard to the PROB(NPV>0) 
statistic, G ranks a poor 8th only because 7 cechm>logies have a probability 
of unity that NPV>0. For G, its probability of a positive NPV is 98%. 

Again, this ranking seems to overplay the risk of G. Thus, the ^derate 
attitude toward risk, using the y-a criterion best represents the Tech 
team's assessment of the one best ranking. 

The final rankings have methological implications as well as che 
obvious operational ones. First, the final rankings provide a test of the 
screening methodology. Screening was meant to be a predictor of final ranking. 
It is only in this sense that screening allows Che "worst" technologies to be 
filtered away. It turns out there is 100% agreeo»nt between the screening 
results and the y ranking, and a 99% agreement between screening and the y-d 
ranking. 'Hius, che validity of the screening approach is upheld. 

In addition. Is the notion of the risk spectrum valid? Do the rankings 
change systematically across the spectrum? A test of this systematic change 
was devised, and was passed 100%. This established that rankings are not 
too sensitive to small changes along the risk spectrum. This n»ans that 
rankings are not drastically changed if risk attitude vacillated between 
for example, nK>derate to somewhat risky. This is a characteristic one 
might well demand from a spectrum of ranking criteria. 
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SECTION 5 
CONCLUSIONS 


The questions of whether or not NASA should support the further development 
of space communications technology and which technclogies, if any, should be given 
the highest priority have been attacked from a cost-benefit point of view. Both 
qualitative and quantitative methods for addressing the Issues have been formulated 
and applied. The screening, assessment, and ranking methodologies have been 
applied to conceptual communications systems and subsystems which resulted from the 
user preference and technology state-of-the-art surveys. Baseline scenarios with 
associated forecast demands for communication channels and forecast channel cap- 
acity per satellite have been used together with estimates of improvements in 
communication systems resulting from specific technology developments to estimate 
the value to the nation of U. S. government support of the development of space 
communications tec mclogy. 

A set of nine technologies have been carried through the screening, assessment, 
and ranking methodologies. Eight of the nine technologies (all except low cost 
direct demodulation earth station equipment) passed the qualification test based 
upon market failure (the failure of the private sector to provide adequate financial 
incentives to potential developers). The quantitative methodology application resulted 
in mean and standard deviation values for the net present value of each proposed 
technology development program. A ranking of the technologies according to several 
statistics of interest has been deve^oed and is presented below. The technologies 
are listed in order of decreasing value. 

(1) Millimeter communications systems 

(2) Solid state power amj lifier (satellite) 

(3) Low cost earth stations 

(4) Multi-beam antenna 

(5) Ion engine 

(6; Adaptive heat pipe 

(7) RF attitude sensor 

(8) Laser communication system 

(9) Advanced solar array 

This ranking is according to economic considerations only, and is to be used as a 
design aide by the decision maker; it is not an end in itself. 

Some general conclusions, in addition to the specific ranking of the above 
technologies, iiave been made. Th - screening, assessment, and ranking m ethodologies 
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developed within the program provide a consistent, tractable, defensable, and 
quantitative approach to evaluating potential NASA R & D programs. Economic 
evaluation of the technologies from a cost-benefit viewpoint has shown that 
certain technologies s)x)uld be implemented with government support to accrue 
maximum benefits to the nation as a whole. NASA, as the appropriate government 
agency, should play an important role in advancing future communications technology. 
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